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^ — I Abstract 

o 

P\| The question of when zeros (i.e., sparsity) in a positive definite matrix A are pre- 

;_i served in its Cholesky decomposition, and vice versa, was addressed by Paulsen et al. 

02] [see Journ. of Fund. Anal, 85, 151-178]. In particular, they prove that for the 
pattern of zeros in A to be retained in the Cholesky decomposition of A, the pattern of 
zeros in A has to necessarily correspond to a chordal (or decomposable) graph associated 
with a specific type of vertex ordering. This result therefore yields a characterization 
of chordal graphs in terms of sparse positive definite matrices. It has also proved to be 
extremely useful in probabilistic and statistical analysis of Markov random fields where 
\^ zeros in positive definite correlation matrices are intimately related to the notion of 

stochastic independence. Now, consider a positive definite matrix A and its Cholesky 
(-h decomposition given by A = LDL T , where L is lower triangular with unit diagonal 

entries, and D a diagonal matrix with positive entries. In this paper, we prove that a 

S necessary and sufficient condition for zeros (i.e., sparsity) in a positive definite matrix 
A to be preserved in its associated Cholesky matrix L, and in addition also preserved 
in the inverse of the Cholesky matrix L~ x , is that the pattern of zeros corresponds to a 
£N| co-chordal or homogeneous graph associated with a specific type of vertex ordering. We 

proceed to provide a second characterization of this class of graphs in terms of determi- 
nants of submatrices that correspond to cliques in the graph. These results add to the 
growing body of literature in the field of sparse matrix decompositions, and also prove 
to be critical ingredients in the probabilistic analysis of an important class of Markov 
random fields. 

Key words: Cholesky decompositions, Positive definite matrices, Sparsity, Decomposable 
t— l graph, Co-chordal graph, Permutation, Clique Determinant. 
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1 Introduction 

Chordal and co-chordal graphs, and their relationships to sparse matrix decompositions, 
play an important role in the probabilistic and statistical analysis of Markov random fields 
(see [131 HU HS1 [23] ) . In these models the above classes of graphs are used to encode zeros 
in covariance or correlation matrices (or their inverses). The zero entries in these positive 
definite correlation matrices are intimately related to the notion of stochastic independence. 

A characterization of chordal graphs or decomposable graphs, the class of graphs con- 
taining no induced cycle of length greater than or equal to 4, in terms of appropriate 
sub-manifolds of positive definite matrices was provided in [19] . In particular, positive defi- 
nite matrices with zero entries according to a decomposable graph necessarily preserve these 
zero entries in their respective Cholesky matrices. The task undertaken in this paper is to 



1 



find parallel and useful characterizations of co-chordal or homogeneous graphs, the class of 
graphs containing no induced 4-cycle or 4-path, in terms of appropriate sub-manifolds of 
positive definite matrices. 

Let G = (V, E) denote an undirected graph, where V = {1, 2, • • • , \V\} represents the 
finite vertex set and E denotes the corresponding edge set. We use the notation M p to 
denote the set of p x p symmetric matrices and to denote the set of p x p positive 
definite matrices. Without loss of generality, the notation used in this paper specifies the 
permutation or ordering a £ S p , where S p denotes the symmetric group, by a p-tuple 
describing where (1, 2, • • • ,p) is sent by a. Thus, a = (1 2 5 4 3) means cr(l) = 1, a (2) = 
2, <t(3) = 5, cr(4) = 4 and a (5) = 3. Without ambiguity, in some places in the paper we will 
denote a, an element of the symmetric group on p-letters, by a p-tuple describing where 
(u, v, w, ■ ■ ■ ) is sent by a. As we explain shortly, these orderings play an important role in 
our results. Given a graph G = (V, E) and an ordering a of the vertices of the graph, we 
define 

P Ga = {s € M+ , : = whenever (a' 1 (i) , a' 1 (j)) $ e} , 

and 

C Ga = {L£ M m : Lu = l,Lij = for i < j or (a' 1 (i) , a' 1 (j)) <£ E) . 

The space Pc a is essentially a sub- manifold of the space of | V| x \V\ positive definite matrices 
where the elements are restricted to be zero whenever the corresponding edge (under the 
ordering a) is missing from E. Similarly, the space Cc a is a subspace of lower triangular 
matrices with diagonal entries equal to 1, such that the elements in the lower triangle are 
restricted to be zero whenever the corresponding edge (under the ordering a) is missing 
from E. We now state the main theorem of the paper. It characterizes co-chordal or 
homogeneous graphs in terms of (1) sparse matrix decompositions and (2) determinants of 
submatrices of cliques in the graph. 

Theorem 1 Consider a graph G = (V, E) together with an ordering of its vertices as 
denoted by a . Then the following statements are equivalent. 

1. G is a homogeneous graph and a is a Hasse tree based elimination schem^ 

2. If D is an arbitrary diagonal matrix with positive diagonal entries, then 

Le£ Ga & L- 1 € C Ga S := LDL T G P Ga . 

3. Let S G P GtJ be arbitrarily chosen. Let S = LDL denote its modified Cholesky 
decomposition, where L is a lower triangular matrix with unit diagonal entries and D 
is a diagonal matrix with diagonal entries Da, i = 1, 2, ■ ■ ■ ,p. Then for any maximal 
clique C of the graph G, 
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The outline of the remainder of the paper is as follows. Section [2] introduces terminology 
and notation from both linear algebra and graph theory that is required in subsequent 
sections. Section [3] provides a first characterization of co-chordal graphs in terms of sparse 
matrix decompositions. Section [4] provides a second characterization of co-chordal graphs 
in terms of determinants of sub-matrices. The results in Sections [3] and |4] are illustrated 
through examples, which a sophisticated reader can skip. 



a certain type of vertex ordering that will be formally denned later in the paper. 
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2 Preliminaries 



2.1 Graph theory 

This section introduces notation and terminology that is required in subsequent sections. 
An undirected graph G = (V, E) consists of two sets V and E, with V representing the set 
of vertices, and E C V x V the set of edges satisfying : 



When (u, v) G E, we say that u and v are adjacent in G. A graph is said to be complete if 
all the vertices are adjacent to each other, i.e., (u, v ) G E for all it, v G V such that m/d. 
A subgraph of V induced by A C V is the graph G' = (A, En (Ax A)). 

Definition 1 A path connecting two distinct vertices u and v in G is a sequence of distinct 
vertices (uq, ui,..., u n ) where uq = u and u n = v, and for every i = 0, . . . ,n— 1, (iii, G 



Definition 2 A cycle is a path with an additional edge between the two endpoints uq and 
u n - 

Definition 3 A set of vertices A C V is said to constitute a clique if the graph induced by 
A is a complete subgraph ofV. Equivalently, a clique is a set of vertices in V which are all 
adjacent to each other. 

Definition 4 A set of vertices A C V is said to be a maximal clique if A is a clique and 
is not contained in another clique. Equivalently, A <ZV is a maximal clique if it is a clique 
and the graph induced by AU {u}, for any u £ V \ A, is no longer a clique. 

2.2 Modified Cholesky decomposition 

If E is a positive definite matrix, then there exists a unique decomposition 



where L is a lower triangular matrix with unit diagonal entries and D a diagonal matrix 
with positive diagonal entries. This decomposition of E is referred to as the modified 
Cholesky decomposition of E (see |21j). The lemma below provides an explicit formulation 
of the inverse of a lower triangular matrix with unit diagonal entries, and will be useful in 
subsequent sections. 

Lemma 1 Let L be a p x p lower triangular matrix with diagonal entries equal to 1. Let 




E. 



E = 



LDL T , 




A = U p r=2 {r : r G {1,2,--- ,p} r ,n < Ti _i V2<i<r}, 




Lt = II L ^-m , t £A, 



i=2 

where dim(r) denotes the length of the vector r. Then L^ 1 = N, where 

'0 ifi<j 
Nij = I 1 ifi = j 
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(a) (b) 



Figure 1: (a) A decomposable graph, and (b) A non-decomposable graph 
2.3 Decomposable graphs 

An undirected graph G is said to be decomposable if any induced subgraph does not contain 
a cycle of length greater than or equal to four. They are also sometimes known as chordal 
graphs or triangulated graphs. See Figure [T] for an example of a decomposable graph and 
a non-decomposable graph. Since their introduction by Chvatal these graphs have 
been well studied, and are used in various fields such as optimization, computer science, 
probability and statistics. An important branch of probability and statistics where the 
class of decomposable graphs has proven to be quite useful is the study of Markov random 
fields/Graphical models. Decomposable graphs have several characterizations. One such 
characterization is in terms of vertex orderings. We first introduce notation and terminology 
that is required in order to formally state this characterization. 

Definition 5 For an undirected graph G = (V,E), an ordering a of V is known as a 
perfect vertex elimination scheme for G if for every triplet i,j, k with l<i<j<k<p the 
following holds. 

((T^OV- 1 ®) G E, {a-\k),a~\i)) eE^ (a~\k), a~\j)) G E. 

A perfect vertex elimination scheme a for the decomposable graph G in Figure [T] (a) is 
given by a : (u, u', v, v', w) A (3, 4, 2, 5, 1). 

The existence of such an ordering characterizes decomposable graphs (see Paulsen et al 
|19j). More formally, an undirected graph G = (V,E) is decomposable iff there exists an 
ordering a of V, which is a perfect vertex elimination scheme. For a given decomposable 
graph G = (V, E), there can however be several orderings which gives rise to perfect vertex 
elimination schemes. A constructive way to obtain such an ordering is given in Lauritzen 
|16j . There is an interesting and useful connection between decomposable graphs, orderings 
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which give rise to perfect vertex elimination schemes, and the matrix spaces P GtT and C G(J . 

Lemma 2 (Paulsen et al [19J ) Let G = (V,E) be a decomposable graph, and a an or- 
dering of V which corresponds to a perfect vertex elimination scheme for G. Then for any 
positive definite matrix S with modified Cholesky decomposition given byY> = LDL T , the 
following holds. 

L€C Ga ^£€P Gct . 

Hence, for £ £ Pg„i the zeros in £ are preserved in the lower triangle of the corresponding 
matrix L obtained from the modified Chloesky decomposition. Moreover for L £ C Ga , the 
zeros in L are preserved in the matrix £ obtained by £ = LDL T , for any diagonal matrix 
D with positive diagonal entries. The converse of Lemma [2] is also true. 

Lemma 3 (Paulsen et al [19J ) Let G = (V,E) be a graph, a be an ordering of V , and 
D be an arbitrary diagonal matrix with positive diagonal entries. Suppose 

LeC Ga ^^:=LDL T eP Ga . 

Then G is a decomposable graph and a corresponds to a perfect vertex elimination scheme 
forG. 

Hence, Lemma [2] and Lemma [3] characterize a decomposable graph G and a perfect vertex 
elimination scheme a for G in terms of the preservation of zeros in the modified Cholesky 
decomposition of matrices in P G(J . These characterizations of decomposable graphs and 
orderings of vertices of G has proven to be tremendously useful for working with sparse 
positive definite matrices in probability and statistics (see [151 El ESI 1221 E2])- Another 
class of graphs that is also highly useful in this context is the class of co-chordal graphs or 
homogeneous graphs (see [2 [131 EH 113 E] ) • Yet characterizations of homogeneous graphs, 
similar to the above for decomposable graphs, are not available. These characterizations 
are the subject of the rest of the paper. 

2.4 Homogeneous graphs 

A graph G = (V, E) is defined to be co-chordal or homogeneous if for all v, v' such that 
(v, v') £ E, either 

{u : u = v or (u, v) £ E} C {u : u = v or (u, v) £ E}, 

or 

{u : u = v or (n, v) £ E} C \u : u = v or (u, v) £ E}. 

Equivalently, a graph G is said to be homogeneous if it is decomposable and does not con- 
tain the graph • — • — • — denoted by A4, as an induced subgraph. See Figure [2] for 
an example of a homogeneous graph, and a non-homogeneous graph which is decompos- 
able. Connected homogeneous graphs have an equivalent representation in terms of directed 
rooted trees, called Hasse diagrams. The reader is referred to [17] for a detailed account of 
the properties of homogeneous graphs. We write v — > w whenever 

{u : u = w or (n, w) £ E} C {u : u = v or (u, v) £ E}. 
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u' v' 



(a) (b) (c) 

Figure 2: (a) A homogeneous graph, (b) A non-homogeneous graph which is decomposable, 
and (c) The Hasse tree corresponding to the homogeneous graph in (a). 

Now denote by R the equivalence relation on V defined by 

uRv 44> u — > v and v — > u. 

Let v denote the equivalence class in V/R containing v. The Hasse diagram of G is 
defined as a directed graph with vertex set Vh = V/ R = {v : v £ V} and edge set Eh 
consisting of directed edges with (u,v) G Ejj for u 7^ v if the following holds: u — >• v and 
$v' such that u — > v' — > v, v' 7^ u, v' 7^ v. 

If G is a connected homogeneous graph, then the Hasse diagram described above is a 
directed rooted tree such that the number of children of a vertex is never equal to one. It 
was proved in |17j that there is a one-to-one correspondence between the set of connected 
homogeneous graphs and the set of directed rooted trees with vertices weighted by positive 
integers (w(u) = \u\), such that no vertex has exactly one child. If u — )■ v and u 7= v, we say 
that u is an ancestor of v in the Hasse tree of G. It is easily seen that if G is a disconnected 
homogeneous graph, then each connected component of G gives rise to a Hasse tree. If 
u = v, we say that u is a twin of v in the Hasse tree of G. 

A subclass of orderings associated with a homogeneous graph, which will be used in 
subsequent analysis, is defined as follows. 

Definition 6 If G = (V, E) is a homogeneous graph, then an ordering a of V is defined 
to be a Hasse tree based elimination scheme for G if for every pair of vertices u, v, the 
following holds. 

u — > v, u 7^ v =^> a(u) > a{y). 

Alternatively, if u is an ancestor of v in the Hasse diagram of G, then o~(u) > o~(v). 

The lemma below follows easily from the definition of homogeneous graphs. 

Lemma 4 (a) If G{ = (Vi,Ei) is a homogeneous graph for every 1 < i < n, and Vi and 
Vj are disjoint for every 1 < i 7^ j < n, then G = (Uf =1 Vi, Uf =1 Ei) is also a homogeneous 
graph. Conversely, if G = (V, E) is a homogeneous graph, then any disjoint connected 
component of G is also a homogeneous graph. 
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(b) If G = (V,E) is a connected homogeneous graph, \V\ = m, and a is a Hasse tree based 
elimination scheme for G, then the equivalence class ofa^ l {m) lies at the root of the Hasse 
tree of G. 

Example 1 Consider the homogeneous graph G in Figure^ (a) and the corresponding 
Hasse tree in Figure^ (c). A Hasse tree based elimination scheme a for the homoge- 
neous graph G is given by o~(w) = 5,a(v) = A,a(v') = 3,o~(u') = 2,a(u) = 1. Note 
that a homogeneous graph is also a decomposable graph, and a Hasse tree based elimina- 
tion scheme is also a perfect vertex elimination scheme. However, every perfect vertex 
elimination scheme for a homogeneous graph may not necessarily be a Hasse tree based 
elimination scheme. For the homogeneous graph G in Figure^ (a), the ordering a given by 
cr(v') = 5, o~(w) = 4, a(u') = 3, a(u) = 2, a(v) = 1 is a perfect vertex elimination scheme, but 
not a Hasse tree based elimination scheme, since w->w',w/«' but a(w) = 4 < cr(v') = 5. 

3 Characterization in terms of sparse matrix decompositions 

We now provide the first characterization of homogeneous graphs that yields a parallel 
result to that of Paulsen et al. [19] for decomposable graphs. We note that antecedents of 
the results in Paulsen et al. [H] were given in (6j [HJ H]- 

Lemma 5 (Khare and Rajaratnam |15j) Let G = (V,E) be a homogeneous graph, and 
a an ordering ofV which corresponds to a Hasse tree based elimination scheme for G . Then 
for any positive definite matrix S with modified Cholesky decomposition given byT, = LDL T , 
the following holds. 

SePc^iac^ L- 1 g L Ga . 

A detailed constructive proof is given in [14J. A proof in a more general context can also 
be found in [2] and |18j . One of the main results of this paper is the converse of Lemma [5j 

Proposition 1 Let G = (V, E) be a graph, a be an ordering of V , and D be an arbitrary 
diagonal matrix with positive diagonal entries. Suppose 

LeC Ga ^ L- 1 £ Cc a 44> S := LDL T G P Ga . 

Then G is a homogeneous graph and a corresponds to a Hasse tree based elimination scheme 
forG. 

Proof: We proceed by induction and prove the result in a series of claims. 

Claim 1: The result holds for \V\ =3. 

Proof of Claim 1: Let V = {u, v,w}. We consider two cases. 

Case I: E = <f>, {(u, v)}, {(u, w)}, {(v, w)} or {(u, v), (u, w), (v, w)}. See Figure [3} 
G is a homogeneous graph in every case. Also, each disjoint connected component is a com- 
plete graph, which means that every ordering corresponds to a Hasse tree based elimination 
scheme. Hence, the result holds vacuously. 

Case II: E = {(u, v), (v, w)}, {(u, w), (v, w)} or {(u, v), (u, w)}. See Figure [4j 
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Figure 3: Case I with \V\ = 3 for Proposition [T] 
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Figure 4: Case II with |V| = 3 for Proposition [T] 

Let us first consider the case E = {(u,v), (v,uu)}. Note that G is a homogeneous graph. It 
remains to be shown that a is a Hasse tree based elimination scheme. Now if cr(v) = 1, and 




1=1 l eC Ga , 
V V 

then E32 = {LDL T )^2 = d\\ 7^ 0. Hence, £ £ Pg^i yielding a contradiction. Similarly, if 
a(v) = 2, and 

/I 0\ 
L= 1 1 €C Ga , 
\0 1 1/ 

then L^ 1 = 1^0. Hence, L" 1 ^ Cg<?, once more yielding a contradiction to the assump- 
tions in the proposition. Hence a(v) = 3. Note that v — )• u,v — )• w and v ^ u,v ^ w. 
Hence, any ordering a such that cr(v) = 3 is a Hasse tree based elimination scheme. The 
other cases when E = {(u, w), (v,w)} and E = {(u, v), (u,w)} follow by symmetry. Hence, 
the result for \V\ = 3 holds true. 

As mentioned earlier, we shall use an induction argument on the number of vertices to 
prove the result. Suppose now that the result holds true for all graphs with m — 1 vertices. 
Let G = (V, E) be a graph with | V| = m, and a be an ordering of V for which 

L G C Ga & I' 1 ei Gj »S := LDL T G P Ga , 

for an arbitrary diagonal matrix D with positive diagonal entries. We need to show two 
results: (i) G is homogeneous and (ii) the ordering a is a Hasse tree based elimination 
scheme. 

Let G' be the subgraph induced by G on the set of vertices V \ {a^ 1 (m)}, and let 
a' be the restriction of a on V \ {cr _1 (m)}. Note that G' together with the ordering a' is 



8 



none other than G with the ordering a (or G a ), but with the highest labeled vertex removed. 



Claim 2: 

L* G L a 45 (V)~ x e C G < 45 S* = L*D*{L*) T G P G > . 
where D* is the upper (m — 1) x (m — 1) principal submatrix of D. 
Proof of Claim 2: Let L* G £ G / . Then 

a' 



//-r*\-l 



L* 0\ _ /(L 
T 1 i " T 



(L*)" 1 € £ G ' 



By a similar argument (L*) -1 G Cq> =5 L* G £ G / . Hence (L*) -1 G £ G ' 45 L* G £ G ' . 

cr' cr' cr' cr' 

Note that, 

V G £ G , , 

\ u is mm J 

45 S* := L*D*(L*) T G P G / . 
Hence, we have now established that 

L* G £ G ' ( 45 (L*)- 1 G £ G / ( 45 S* = L*D*(L*) T eP ff . 



By the induction hypothesis, it follows that £?' is a homogeneous graph and cr' corresponds 
to a Hasse tree based elimination scheme for G' , i.e., 

o~'(v) = a(v) < o~'(u) = c(u) when u ^ v,u ^ v, Vu, v G V \ {cr -1 (m)}. (2) 

Claim 3: G is a homogeneous graph and a is a Hasse tree based elimination scheme. 

Proof of Claim 3: Now let V = U^ =1 Vi, where V% is the vertex set corresponding to the i th 
disjoint connected component of G' . 

Suppose {a~ l {m),u) ^ E for each u G V \ {cr _1 (m)}, i.e., the vertex o~ l {m) is discon- 
nected from the graph G' . Then by Lemma |4j the graph G is a homogeneous graph with 
V = (u^ =1 Vi) U {<7 _1 (m)} being the disjoint partition of the vertices corresponding to its 
disjoint connected components. Also, from ^ and the fact that a^ 1 {m) is disconnected 
from every vertex in V\{o~~ 1 (m)}, it follows that a is a Hasse tree based elimination scheme 
for G. 

Suppose (<7 _1 (m), u) G E for some u G Vi- Let v* G Vt be such that cr(v*) = 
max^g^ a(vi). Since G' is a homogeneous graph, a restricted to V \ {cr _1 (m)} is a Hasse 
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tree based elimination scheme, and V\ is the vertex set corresponding to a connected com- 
ponent of G', it follows from Lemma [4] that the equivalence class of v* lies at the top of the 
Hasse tree of Vi in G' . We therefore deduce that (v*, Vi) G E, V-Uj G V{. 

We proceed by claiming that {a~ 1 {m),vl) G £\ If u* = u, it follows immediately. If 
v* 7^ u, then m > o{v*) > a(u). Suppose L is defined by 



Lij 



1 if i = m,j = a(u) or i = a(v*),j = <j{u) or i = j, 
otherwise. 




Note that L G £g ct - If S := LL T , then by assumption S G P<? CT , and 

Hence, it follows that (a _1 (m),u*) G -E. Now let G V^, t>j 7^ v*. We also now claim that 
((j _1 (m), Wj) G -E 1 . Note that (v*,Vi) G E from the discussion above. Suppose L is defined 
by 

if % = m,i = cr(u*) or i = cr(v*),j = a(vi) or i = j, 
otherwise. 

First note that L G £g CT ) an d hence by assumption L _1 G £g ct - Since > = 1 (by 

using the inversion formula in Lemma[l]), it follows that (o" _1 (m), V{) G E. Hence, we have 
established that if (<r -1 (m), u) G E for some u GV,, then (cr _1 (m), t>j) G E for every i>j G Vi. 

Now let Vi x , Vi 2 , • • • , Vi p be the components of G' which share at least one edge with 
cr _1 (m). Since the graph induced by Vi r on G' is a connected homogeneous graph for every 
1 < r < p, and <r~ 1 (m) is connected to every vertex in V^, Vi 2 , ■ ■ ■ , Vi p by the argument 
above, the introduction of o~ l (m) does not give rise to any new 4-cycle or 4-path, due of 
the following reasoning: Consider an arbitrary collection of 4 vertices in V. If all of them 
lie in Vi r for some r, and if a^ 1 (m) is not one of the vertices, then these 4 vertices cannot 
form a 4-cycle or a 4-path as the subgraph induced by Vi r on G is a homogeneous graph. If 
none of the vertices is <7 _1 (m), and all of them do not lie in V, r for some r, then the graph 
induced by these vertices on G is a disconnected graph, which implies that the induced 
sub-graph cannot be a 4-cycle or a 4-path. Finally, if a~ 1 (m) is one of the vertices, and 
since it is connected to all the other three vertices, they cannot form an induced 4-cycle or 
an induced 4-path. 

It follows that the graph induced by {a~ 1 (m)} U (U^ =1 Vi r ) on G is a connected homo- 
geneous graph. Moreover, since a~ l {m) is connected to every vertex in Vi i: Vi 2 ,--- ,VL, 
its equivalence class has to lie at the root of the corresponding Hasse tree. Note that the 
disjoint connected components of G' other than V^, V{ 2 , • • • ,Vi p are also connected homoge- 
neous graphs. It follows that G is a homogeneous graph with disjoint connected components 
{(T _1 (m)} U {\J p r=l Vi r ) and Vt, t 7^ ,i p - Note that a' (which is the restriction of 

a to G') corresponds to a Hasse tree based elimination scheme for G' , and that cr(u) < m 
whenever u 7^ a~ l (m). Hence, cr(u) < m whenever a~ l {m) — > u, o~ l (m) 7^ u. Also, since 
a (m) is at the top of the Hasse tree in its connected component, there does not exist 
u G V \ {o' _1 (m)} such that u — > cr -1 (m). This leads us to conclude that a is a Hasse tree 
based elimination scheme for G. Hence the result is proved. □ 
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Remark: A useful alternative probabilistic characterization of homogeneous graphs can 
be found in |20|l5]. This probabilistic result essentially states that G is homogeneous iff U G 
is Markov equivalent to a directed acyclic graph(DAG)". In contrast, the characterization 
proved in this section is algebraic in nature, and is therefore different from the proba- 
bilistic characterization. The algebraic characterization above can be established directly 
starting from the probabilistic characterization mentioned above, by using the notion of 
"d-separation" . The proof however is non-trivial and does not seem to offer a simplification 
over the first principles proof provided here. 

We now give a series of examples to illustrate the necessity of the assumptions in the 
characterization discussed above. 

Example 2 Consider the homogeneous graph G in Figure^ (a). Let a be a Hasse tree 
based elimination scheme defined by o~(w) = 5,o~(v) = 4,a(v') = 3,a(u') = 2,a(u) = 1. Let 
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Now consider a which is a perfect vertex elimination scheme, but not a Hasse tree based 



elimination scheme, 


given by 


a(v') = 5,a(w) = 4, 


a(u') 


= 3, 


a(u) = 


2,o- 


(v) 


= 1. Then 




(1 


0\ 






( 1 











o\ 






1 












1 













L = 


1 


1 


£C Ga , butL- 1 = 







-1 


1 












1 1 


1 1 






-1 





-1 


1 









Vo i 


1 1 l) 






V i 








-1 


V 





It can be verified that S = LL T G Pq . Now let a be given by cr(v) = 5,a(u') = A,a(v') 
3,a(w) = 2,a(u) = 1. Then, a is not a perfect vertex elimination scheme, and 



L 



(\ 0\ 
110 
1110 
11110 

\0 1 I J 



e£ GtT , butE = LL q 



fl 1 1 1 0\ 

1 2 2 2 1 

1 2 3 3 1 

1 2 3 4 1 

\0 1 1 1 2/ 



Now consider the non-homogeneous graph G in Figure^ (b). Note that G is however a 
decomposable graph. The ordering a given by cr{u') = 4,o~(w) = 3,a(u) = 2,a(v) = 1 is a 
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perfect vertex elimination scheme. However, 



L 



(1 0\ 
110 
110 

\0 1 1/ 



6 £g ct > but L 



-l 



/I 
-1 

1 

V-i 



o 
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0\ 
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-1 1/ 



4 Characterization in terms of determinants 



We now give a second characterization of homogeneous graphs with vertex orderings cor- 
responding to Hasse tree based elimination schemes. Let us first establish some notation, 
that shall be used throughout this section. If A G M n and M, M* C {1, 2 • • • , n}, then 

Am '■= ((Aij))ij(zM, Amm* '■= ({Aij))ifzM,jeM* ■ 

The proposition below and its converse, stated and proved subsequently, provide the second 
characterization of homogeneous graphs. 

Proposition 2 Let G = (V, E) be a homogeneous graph, and a an ordering of V which 
corresponds to a Hasse tree based elimination scheme for G. Let £ G PG a! an d £ = LDL T 
denote its Cholesky decomposition. Then, for any maximal clique C , 

1 

L\i 



\^- i uo\= n 

ie<r(C) 



Proof: Let C C V be a maximal clique in G, where C 
a(u2) > ■■■ > a(u r ). First note that 

iT 



{ui,U2, • • • , n r }, with a(ui) > 



)a(C) 



)a(V)a(C)\ 



D- 1 [(L 



-1\ 



)a{V)a{C)\ 



(3) 



We will prove that the determinant of the RHS of ^ equals the determinant of 



D 



(C)J. 



and the result will follow. 



We start by first showing that L 



-l 

cr(w)a(ui) 



when w ^ C for i = 1, 2, • • • , r. Note that 



cr(uj) > cr(w), L , a ( w -s a r u A = 0, as L 1 is a lower triangular matrix. Now let cr(uj) < o~(w). 
Suppose to the contrary that L~^ w \ a ^ u .\ ^ 0. Since L" 1 G Lc a by Lemma j5j we get 
(w,Ui) G E. Hence, w is an ancestor or twin of U{ in the Hasse tree of G. Now by the 
very definition of a homogeneous graph, every vertex sharing an edge with m also shares 
an edge with w. Hence, (w, Uj) G E for j = 1, 2, • • • , r, which gives a contradiction to the 
maximality of C. Hence we conclude that L"^}*,^ = when w ^ C for i = 1, 2, • • • , r. 
Now using the Cauchy-Binet identity in (|3|), 



-In 



)a{C)\ 



-Is 



V(V)er(C) 

J] | [(• £ '~ 1 )«t(A)«t(C0 
ACV,\A\=r 



(V)a(C)\ 



a(A) 



(A)a(C)\ 



Note that if A C V, |^4| = r, and A ^ C, then there exists w such that u; G A but w ^ C. 
Hence, from the argument above, L~, w N = for z 



[(£ 1 )j(A)(r(C)] T 'f 1 



(A) CT (C)J 



1, 2, • • • , r, and for such A ^ C, 



a(A)a(C)\ 



D °Ia) 



(A)a{C)\ 
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since one row in the matrix (L )<j(A)<t(C) is zero. Therefore the only non-zero summand in 
the Cauchy-Binet formula is when A = C. Hence 

k^- 1 )^)! = | [(i- 1 )^)]^! i^-^i i [c^- 1 )^)] i = n ± 

ie*(C) 11 

where the last equality follows from the fact that {L^ l ) a ^ is a lower triangular matrix 
with all diagonal entries equal to one (and therefore has determinant one) , and ^^(C) * s a 
diagonal matrix. Hence the result is proved. □ 

We now proceed to prove the following lemma required in the proof of the converse of 
Proposition [2j 

Lemma 6 Let G = (V,E) be a A-cycle or A-path, and let a he an ordering of V . Then, 
irrespective of the way a orders the vertices of the A-cycle or the A-path, there exist u,v,w G 
V such that (u, v), (v, w) G E, (u, w) £ E, and a(v) < a(u) < a(w) or a(u) < a(v) < a(w). 

Proof: (i) Let G be a 4-cycle. Recall that u, v G V are said to be neighbors in G if (u, v) G E. 
Consider the two neighbors of v := <7~ 1 (1). Let u denote the neighbor with the smaller 
a- value, and w denote the remaining neighbor. Note that (u, v), (v, w) G E, but (u, w) ^ E. 
Also, a{v) = 1 < o~(u) < a(w). 

(ii) Let G be a 4-path. We consider three possibilities which are exhaustive, and in each 
case show the existence of three vertices with the required properties. 

Case I cr _1 (l) has two neighbors: Let v := <t _1 (1). In this case, let u denote the neighbor 
with the smaller a- value, and w denote the remaining neighbor. Hence, o~(v) = 1 < 
a(u) < a(w). 

Case II <t _1 (1) has one neighbor, and a _1 (2) has two neighbors: Let v := <t~ 1 (2). If 
one of the two neighbors of v = cr _1 (2) is u = cr _1 (l), denote the remaining neighbor 
by w, and observe that <j(w) is equal to 3 or 4. Hence, a(u) = 1 < a(v) = 2 < a(w). 
If the neighbors of v = a~ 1 (2) are u = a~ 1 (3) and w = o" _1 (4), then a(v) = 2 < 
a(u) = 3 < a(w) = 4. 

Case III 0" _1 (1) and cr _1 (2) both have one neighbor: In this case, v := cr _1 (3) has two 
neighbors, one of which has to be w = a -1 (4). Let u be the remaining neighbor and 
observe that a(u) is equal to 1 or 2. Hence, a(u) < a(v) = 3 < a{w) = 4. 

We now establish the converse of Proposition [2] 

Proposition 3 Let G = (V, E) be a graph, and a be an ordering of V . Now if G is not a 

homogeneous graph, or if G is a homogeneous graph and a does not correspond to a Hasse 
tree based elimination scheme for G, then there exists a maximal clique C , and S G Pc a 
such that 

\^ x uo\ + n 

where S = LDL denotes the modified Cholesky decomposition o/S. 
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Proof of Proposition^ We shall prove the result for each of the two possible cases. 
Case I: G is not a homogeneous graph. 

As the graph G is not homogneous, it contains a 4-cycle or a 4-path. If G contains a 4-cycle 
or a 4-path, by Lemma [6j there exist u,v,w £ V such that (u, v), (v,w) 6 E, (u,w) ^ E, 
and o~(v) < o~(u) < o~(w) or cr{u) < o~(v) < a(w). Now define S as follows. 



5 if i = a(v), j = a(v), 
1 iii = j,i^a(v), 

1 if i = cr(v),j = a(u) or i = a(v),j = a(w) 

or i = a(u),j = a{v) or i = a(w),j = cr(v), 
otherwise. 



Then X G Po a . Note that all the diagonal entries of £ are 1 and all off-diagonal entries are 
except the 3x3 submatrix for a(u), a(v), a(w). Hence, S is a permuted block diagonal 
matrix with o~(u),a(v),a(w) forming one block and every other index forming a block by 
itself. Using the simple fact that the inverse of a permuted block triangular matrix is 
permuted block triangular, we get that 



y- 1 



if i = a(v),j = o-(v), 

if i = cr(u),j = a(u) or i = a(w),j = cr(iv), 
if i = j,i ^ or o~(u) or cr(w), 
if i = cr(v),j = a(u) or i = a(v),j = a(w), 
or i = <t(m), j = a(v) or i = a(w),j = a(v), 
if i = cr(n),j = a{w) or i = a(w),j = cr(u), 
otherwise. 



Let C denote the maximal clique of G containing u and v. Note that w £ C. Let S3 denote 
the 3x3 submatrix of S corresponding to a(u),a(v),a(w). Let S3 = L^D^L^ denote 
the modified Cholesky decomposition of S3, and S = LDL T be the modified Cholesky 
decomposition of S. For i,j £ {a(u), o~{v ), o~(w)}, let us define for simplicity of notation, 
(Ls)ij as the entry in the row corresponding to o~ l {i) and the column corresponding to 
& (j) m ^3- Using the property that all the diagonal entries of S are 1 and all off-diagonal 
entries are except for S3 , and the uniqueness of the modified Cholesky decomposition of 
S, it follows that 



L 



(L 3 )ij if i > j, i,j e {a(u),a(v),a(w)}, 



if i = j, 
otherwise, 



and 



Da 




if i = cr(u), a(v) or a(w), 
otherwise. 



The actual values of the elements of L3 and -D3 however, depends on the relative order of 
a(u),a(v),a(w). If a{v) < a(u) < a{w), then D a{v)a{v) = 5, D a{u)(T{u) = |, D a{w)a{w) = f 
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and Da = 1 if i ^= cr(v), o~{u) or a(w). Hence, 

)<KC)i=3^ n 

i6cr(C) 



1 __ 1 

Dii ~ 4' 



If cr(ti) < cr(V) < cr(», then D^)^) = 1, D u{v)u{v) = 4, D a{w)a{w) 
i ^ cr(n),(r(f) or a(w). Hence, 



| and D u = 1 if 



)<r(C)\ 



I* n 

te<T(C) 



1 __ 1 



Case II: G is homogeneous but a is not a Hasse tree based elimination scheme. 
Since a is not a Hasse tree based elimination scheme, there exist vertices a,b £ V such that b 
is an ancestor of a in the Hasse tree of G, and a(b) < a (a). Since b is an ancestor of a, there 
exists c G V, such that (6, c) £ E and (a, c) ^ £\ Now there are three possibilities for the way 
a orders a,b,c given that a(b) < a (a), namely, a(b) < a{a) < cr(c) or a(b) < a(c) < a(a) 
or a(c) < a(b) < a (a). Let v = b, u = a, w = c for the first possibility, and v = b, u = 
c, w = a for the latter two possibilities. Then note that (u,v), (v,w) G E, (u,w) ^ E, 
and a(v) < a(u) < a(w) or cr(u) < a(v) < a(w). We have thus shown the existence 
of vertices u,v,w such that (u,v), (v,w) G E, (u,w) E, and a(v) < a(u) < a(w) or 
cr(u) < cr(v) < a{w). We can therefore use the same E and maximal clique C as in Case I 
above, and reach the desired conclusion. Hence the result is proved. □ 

We now illustrate the proposition through an example. 

Example 3 Consider the homogeneous graph G in Figure^ (a). The maximal cliques are 
given by C\ = {w,v',u',u} and C2 = {w,v}. The ordering a given by a(w) = 5,a(v) = 
4, ct{v!) = 3, a(u) = 2, o~(v') = 1 is a Hasse tree based elimination scheme. Let 
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5/ 



Then, 



and 



|( S )<r(C x )| 



Mc 2 ) I 



1 



n 

iea(Ci) 

n 



1 

1 



Now consider a which is a perfect vertex elimination scheme, but not a Hasse tree based 
elimination scheme, given by o~(v') = 5,a(w) = 4,a(u') = 3, o~(u) = 2,a(v) = 1, then 
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but 



y- 1 

a(C 2 ) 



2 * n I 



1. 



iea(C 2 ) 
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\o 
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•V 



Now let a be given by a{v) = 5,a(u') = 4,a(v') = 3,a(w) = 2,a(u) = 1. Then, a is not a 
perfect vertex elimination scheme, and 



but 

K^T 1 )^)! = 0.002042484 / — = 0.001953125. 

Consider the non-homogeneous graph G in Figure^ (b). Note however that G is a decompos- 
able graph. The maximal cliques are given by C\ = {u',w},C2 = {w,u},Cs = {u,v}. The 
ordering a given by cr(it') = 4, a(w) = 3,o~(u) = 2,o~(v) = 1 is a perfect vertex elimination 
scheme. Let 

(2 1 0\ 
12 10 
12 1 
\0 1 2) 



S 



Note however that 



* ii , 



ie<r(C 3 ) 



The two characterizations in the paper are summarized in the main theorem in the intro- 
duction. 

Acknowledgments: We wish to thank Professor Ingram Olkin for his encouraging remarks 
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